Goto

Collaborating Authors

 comprehend entire book


Google's new AI language model can comprehend entire books

#artificialintelligence

One of the prime challenges of a language-based AI model is to understand the context of the surrounding content. To solve this problem, Google has introduced a new model called Reformer, which understands the context of 1 million lines using just 16GB space. The company built this to solve problems of its old model Transformer -- a neural network that compares words in a paragraph to each other to understand the relationship between them. Early birds are even cooler. However, as it uses pair matching, Transformer takes a lot of data space if it needs to process text more than a few thousand words.